Siamese infrared and visible light fusion network for RGB-T tracking
نویسندگان
چکیده
Due to the different photosensitive properties of infrared and visible light, light images have individual features. However, since registered RGB-T image pairs shot in same scene, they also contain common This paper proposes a Siamese fusion Network (SiamIVFN) for RBG-T image-based tracking. SiamIVFN contains two main subnetworks: complementary-feature-fusion network (CFFN) contribution-aggregation (CAN). CFFN utilizes two-stream multilayer convolutional structure that separately extracts features, filters each layer are partially coupled extract is feature-level network, which can cope with misalignment pairs. Through adaptively calculating contributions features obtained from CFFN, CAN makes tracker robust under various conditions. Experiments show compared state-of-the-art techniques, improves PR/SR score 1.5%/8.8% on RGBT234 2.1%/6.9% GTOT. The tracking speed 147.6FPS, current fastest tracker. source codes available at https://github.com/PengJingchao/SiamIVFN .
منابع مشابه
Hierarchical Siamese Network for Thermal Infrared Object Tracking
Most thermal infrared (TIR) tracking methods are discriminative, which treat the tracking problem as a classification task. However, the objective of the classifier (label prediction) is not coupled to the objective of the tracker (location estimation). The classification task focuses on the between-class difference of the arbitrary objects, while the tracking task mainly deals with the within-...
متن کاملFusion of Thermal Infrared and Visible Images Based on Multi-scale Transform and Sparse Representation
Due to the differences between the visible and thermal infrared images, combination of these two types of images is essential for better understanding the characteristics of targets and the environment. Thermal infrared images have most importance to distinguish targets from the background based on the radiation differences, which work well in all-weather and day/night conditions also in land s...
متن کاملA Twofold Siamese Network for Real-Time Object Tracking
Observing that Semantic features learned in an image classification task and Appearance features learned in a similarity matching task complement each other, we build a twofold Siamese network, named SA-Siam, for real-time object tracking. SA-Siam is composed of a semantic branch and an appearance branch. Each branch is a similaritylearning Siamese network. An important design choice in SA-Siam...
متن کاملSimilarity Mapping with Enhanced Siamese Network for Multi-Object Tracking
Multi-object tracking has recently become an important area of computer vision, especially for Advanced Driver Assistance Systems (ADAS). Despite growing attention, achieving high performance tracking is still challenging, with state-of-theart systems resulting in high complexity with a large number of hyper parameters. In this paper, we focus on reducing overall system complexity and the numbe...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Machine Learning and Cybernetics
سال: 2023
ISSN: ['1868-8071', '1868-808X']
DOI: https://doi.org/10.1007/s13042-023-01833-6